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Abstract: Visual guidance is key to our ability to quickly understand the world. To date, studies of variables that af- 
fect these mechanisms in cartography have focused mostly on 2D maps, but 3D visualization, which is now widely 
used, may have different rules for guidance. In this study, we used eye tracking to analyse the visual guidance of 
shape, colour and size in 3D visualization. Thirty-six subjects (24 female and 12 male) participated in the study. The 
results indicated that the visual guidance mechanisms for these visual variables in 3D visualization differ significant- 
ly from 2D maps. Colour and shape provide a high level of visual guidance, but the guidance provided by size, a 
variable that guides the deployment of attention in 2D maps, is much more limited in a 3D environment. 
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1 Introduction 

Visual guidance is important to our perception of the world(Wolfe, 2012; Wolfe & Horowitz, 2004), and help us 
to perceive the world quickly. The development of new techniques for visualizing the natural world (such as 3D 
maps and virtual reality) has opened new and powerful ways to understand the world, which is important to know 
whether the computer-generated creations are properly understood by users. Visual guidance is key to the quick per- 
ception of 3D visualizations. 

Studies of visual guidance have focused mostly on visual variables (colour, size and shape) in traditional 2D 
maps. Colour is the first aspect of visual cognition by which people get to know the world. Numbers (Grubert & 
Eimer, 2013), colour plates(D'Zmura, 1991) and other 2D symbols(Wolfe & Horowitz, 2004) have been used as car- 
riers to demonstrate that colour provides important visual guidance in 2D object searches. Similar experiments have 
shown that subjects have more difficulty searching objects with specific shapes(Quinlan & Humphreys, 1987), and 
that the fixation time on objects of certain shapes in a scene is relatively short compared with those of certain colour 
or size(Williams, 1966), which means that shape provides weaker guidance than colour in 2D tasks. In a 3D envi- 
ronment, however, shape is more variable and has more identical characters(Pizlo, 2010), which means it could pro- 
vide stronger guidance. Wolfe concluded that size clearly guides visual attention(2004) , but this finding is based on 
one-dimensional size (length) (Treisman & Gormican, 1988). Due to the projection in 3D maps, the visual size of an 
object is not only related to its actual size but also to its location and some other projection factors. But few studies 
have compared the differences in 3D visualizations of colour, shape or size. 

Eye-tracking has long been used in the study of geo- visualization. Studies have shown that observers’ gaze pat- 
terns depend on the task(Ehinger, Hidalgo-Sotelo, Torralba, & Oliva, 2009; Hayhoe & Ballard, 2005), thus eye- 
tracking is a practical method for demonstrating the task process and not just the re suits (Broder sen et al, 2002). Eye- 
movement tracking is widely used in map design improvement(Brodersen et al., 2002; Dong, Liao, Xu, Liu, & 
Zhang, 2014; Ooms, De Maeyer, & Fack, 2010) and in comparisons of geo-visualization methods(Dong, Liao, Roth, 
& Wang, 2014; Popelka & Brychtova, 2013; Putto, Kettunen, Torniainen, Krause, & Tiina Sarjakoski, 2014). Eye- 
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tracking is also commonly applied to understand how people understand and comprehend the natural world(Hayhoe 
& Ballard, 2005) and the visualization of it(Gienko & Levin, 2005; Kiefer, Giannopoulos, & Raubal, 2014). 

In this study, we use eye-tracking to evaluate the difference in visual guidance for three common 3D visual vari- 
ables, colour, shape and size. 

2 Methods and Materials 


2.1 Participants 

36 undergraduate/graduate students from Beijing Normal University took part in this experiment. There were 12 
male and 24 female students, with an average age of 22 years old (SD=4.06). None of them reported to have the 
condition of colour anomalopia. All of the subjects had normal or corrected-normal vision. 

The participants were randomly divided into 6 groups. 

2.2 Apparatus 

Tobii Studio (http://www.tobii.com/) eye-tracking technology was used in the experiment. The software, Tobii 
Studio 3.2, was installed on a Lenovo PC. A Tobii T120 Eye Tracker, with a sampling rate of 120 Hz, mounted on a 
17-inch TFT display, which at the time of the study had been used for two years, with a screen resolution of 
1024*768, was used to record the participants’ eye movements. 

2.3 Materials and procedures 

We used Google SketchUp to edit the stimuli (FOV=35° , height of viewpoint h=50 m). The original material 
was true-3D, and was screenshot, so the stimuli were pseudo-3D. 

The first two testing stimuli included cubes, spheres and cones of the same size (the side length of the cubes was 
equal to the diameter of the spheres and cones) but of different colours, which could be red, yellow or blue (Fig. 1). 
Subjects were asked to find and click objects of a certain shape or colour. The third stimulus was yellow cubes, three 
of which were expanded to 120% of the original size. Subjects needed to find and click the bigger cubes without 
knowing exactly how many they should find. 

Each part of the experiment began with a practice stimulus in which the subjects first listened to the experimenter 
explain the task (Table 1) while the practice stimulus was shown on the screen. Once the subject confirmed that 
he/she understood the task, he/she could click the mouse to see the instructions and complete the tasks with no inter- 
ference from the experimenter. 


Table 1 Experiment tasks 



Attribute 

Task 

Expl 

Shape 

Find and click on all the spheres(Gl-G2)/ cones(G3-G4)/ cubes(G5-G6). 

Exp2 

Colour 

Find and click on all the red(Gl-G2)/ blue(G3-G4)/ yellow (G5-G6) objects. 

Exp3 

Size 

Find and click on all the cubes (1 or many) that are bigger than others. 
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Fig. 1 Stimulus of G1-G2 in Expl concerning shape visual guidance. Participants were asked to find all the spheres. Stimulus of Exp 1.2 
was similar. 


3 Analysis and Results 

3.1 Analysis Framework 

In the first part, we used gaze path and five indices to analyse the visual guidance of colour, shape and size. Gaze 
path can show the viewing order(Coltekin, Fabrikant, & Lacayo, 2010). Although it provides valuable information, 
gaze path is rarely used in eye-tracking analysis, because its complexity makes extraction of useful information too 
difficult (Coltekin, Heil, Garlandini, & Fabrikant, 2009; Dong, Liao, Roth, et al., 2014; Irina Fabrikant, Rebich- 
Hespanha, Andrienko, Andrienko, & Montello, 2008). However, in this study, the task is simple and requires just a 
short time, so the gaze path is also simple. In addition, we chose just one example of a gaze path to illustrate the 
process. 

In our experiment, each target was identified as an AOI, and all the AOIs within one single image were formed 
into an AOI group. Five indices used to analyse the visual guidance of a visual variable ar q: finish time , time need- 
ed to complete the task; time to first fixation, time from start of task until the subject fixates on the AOI group for 
the first time; right-click , finish time/correctly judged number; accuracy , correctly judged number/click number; and 
visit ratio , visit duration on AOI group/total visit duration. 

A T-test or M-W U test (depending on whether the statistics fit a normal distribution) was used to test the signifi- 
cance of the difference. 

3.2 Eye-tracking-based performance 

Fig. 2 shows gaze plot of visual guidance tasks for one subject (Gl, Rec 12; a 22-year-old male junior student 
who frequently uses 3D) as an example of the qualitative analysis. Each circle represents a fixation, the diameter of 
the circle represents fixation duration and the number within the circle represents the fixation sequence. 

InFig. 2(a), the subject was asked to find all eight spheres. The first eight fixations are almost all on blue objects, 
with the exception of Fixation No. 5. After the seventh fixation on a blue cone, the subject notices the next blue cone 
and skips the closer yellow sphere (target). Shape shows weaker attractiveness than does colour. After this period, 
however, when the subject became used to the process and repeated the task, he could identify all the spheres quick- 
ly and correctly. 
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Subjects needed to find all nine red objects in Fig. 2(b). There are fewer fixations even though there are more tar- 
get subjects to find. And almost all the fixations are on targets, which mean the visual guidance of colour is stronger. 

As for size, there were 3 bigger objects to find, but fixations were distributed on all the cubes (Fig. 2(c)). This dis- 
tribution might occur because subjects did need to look at all the objects and compare to find the “bigger” ones. 
However, the scan-path shows a horizontal trend, which means subjects couldn’t “feel,” or perceive by split vision, 
the difference in size. The visual guidance of size is thus relatively weak. The finish time for colour (7.924 s) is 
shorter than for shape (10.318 s), and the FT (finish time) for size (1 1.298 s) is the longest. The difference in FT be- 
tween colour and shape/size is significant (tc-sp=3.390, pc-sp=0.001; tc-sz=-3.401, pc-sz=0.001), while the differ- 
ence between shape and size is not (tsp-sz=-0.856, psp-sz=0.395). 

The TtFF (time to first fixation) for colour is the shortest; subjects needed just 1 .281 s on average to fixate on the 
target, while they needed 1.635 s and 1.744 s on average to first fixate on the target object with a certain shape or 
size. However, these differences are all insignificant, with Zc-sz=-0.501, pc-sz=0.616; Zc-sp=-0.192, pc-sp=0.192; 
Zsp-sz=-0.746, psp-sz=0.456. 

RC (right-click) shows the same trend as FT and TtFF. RC for colour is 0.952 s, significantly shorter than that for 
shape (RCsp=1.554 s, tc-sp=5.143, pc-sp=0.000) or size (RCsz=7.280 s, tc-sz=- 10.440, pc-sz=0.000). RC for shape 
is also significantly shorter than that for size (tsp-sz=-9.304, psp-sz=0.000). 

Numerically, the VR (visit ratio) displays a different tendency from the indices above. The VR for colour is the 
largest and that for size is smallest (VRc=0.276, VRsp=0.192, VRsz=0.116). In addition, the differences between 
colour and shape, or colour and size, are both significant (tc-sp=-2.182, pc-sp-<=0.033; tc-sz=5.001, pc-sz=0.000), 
and that between shape and size is also significant (tsp-sz=3.050, psp-sz=0.004). However, a larger VR means that 
when completing this task, subjects are doing more useful work. So in fact, the VR shows the same tendency as the 
other indices. 

Accuracy for colour is the highest (1.000); all subjects completed the task correctly. Accuracy for shape is lower, 
at 0.956. One subject clicked so fast that he did not fully understand the task instructions and three did not find all 
the targets. Accuracy for size is 0.593, which is the lowest. Only 12 subjects found all the targets without regarding 
other objects as targets. 

In this part, we analysed gaze plot and five quantitative indices to illustrate visual guidance of shape, colour and 
size in 3D visualization. All the results indicate that with 3D displays, colour and shape have clearer attention attrac- 
tiveness while visual guidance for size is weaker. 


Table 2 Statistics of Visual Guidance Tasks 



Efficiency 



Effectiveness 



Finish time ( 

s) 

Time to first fix- 
ation (s) 

Right-click time 

(s) 

Accuracy 

Visit ratio 

Shape 

10.318 

1.635 

1.554 

0.956 

0.192 

Color 

7.924 

1.281 

0.952 

1.000 

0.276 

Size 

11.298 

1.744 

7.280 

0.593 

0.116 
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Fig. 2 Gaze plots of Gl, Rec 12 (Fig4(a)), Expl.2(Fig5(b)) and Expl.3(Fig5(c)) 
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Table 3 Result of significance testing in visual guidance task 


Finish time 

(t(p)) 

Shape 

Color 

Time to first 
fixation 

(Z(p)) 

Shape 

Color 

Color 

3.390(0.001) 


Color 

-0.192(0.192) 


Size 

-0.856(0.395) 

-3.401(0.001) 

Size 

-0.746(0.456) 

-0.501(0.616) 

Right-click 

time 

(t(p)) 

Shape 

Color 

Visit ratio 

(t(p)) 

Shape 

Color 

Color 

5.143(0.000) 


Color 

-2.182(0.033) 


Size 

-9.304(0.000) 

-10.440(0.000) 

Size 

3.050(0.004) 

5.001(0.000) 


4 Conclusion 


Differences in visual guidance between colour, size and shape 

Guidance for visual variables is not the same as it is in 2D visualization. Wolfe summarized the research on the 
guidance of visual variables in 2D displays and found that colour and size are most capable of visual guidance, 
while for shape, this is not clear (Wolfe & Horowitz, 2004). 

In our 3D-object experiment, colour provides the same strong guidance as it does with 2D objects (D'Zmura, 
1991; Grubert & Eimer, 2013). This is because colour is not a scene-based visual variable. Although its appearance 
may be influenced by illumination, the colours we used here are quite distinct from each other, so the subjects can 
still notice the targets. 

However, in 3D visualization, visual guidance provided by shape is stronger than that provided by size. This may 
be because in 3D displays, unlike a 2D surface and length, the “ID size,” the same object’s image on a retina is 
smaller when it is far away. Subjects who are aware of this effect will automatically supplement the size (Gori, 
Giuliana, Sandini, & Burr, 2012; Granrud, 2004, 2012), and this requires more time. Also, in a symbolic representa- 
tion, as distinct from the real world, there are not as many objects in the background, resulting in a lack of distance 
hints (Wagner 2012), which are important to the perception of size (Brenner & van Damme, 1999; Hatfield, 2014; 
Kenyon, Phenany, Sandin, & Defanti, 2008). When people could not perceive the correct size, it was unable to suc- 
cessfully guide visual attention. 

As for shape, in going from a 2D to a 3D visualization, shape takes on an extra dimension, which means more 
characters are needed to identify any particular shape. The complexity of visual guidance for shape may also be re- 
lated to the type of shape used. For example, shapes using letters provided strong visual guidance (Quinlan & 
Humphreys, 1987) in 2D visualization, but, according to L.Chen (1982), the shape sensitivity of lines is influenced 
by its conjunction with other shapes. 

5 Acknowledgements 

This research was supported by the National Natural Science Foundations of China (NSFC, Grant No. 41471382). Comments from re- 
viewers are appreciated and helped improve the article’s quality. 

6 References 


Brenner, E., & van Damme, W. J. (1999). Perceived distance, shape and size. Vision research, 39(5), 975-986. doi: doi:10.1016/S0042- 
6989(98)001 62-X 



ICC 2017 : Proceedings of the 2017 International Cartographic Conference, Washington D.C. 


7 


Brodersen, L., Andersen, H. H., & Weber, S. (2002). Applying eye-movement tracking for the study of map perception and map design : National 
Survey and Cadastre. 

Coltekin, A., Fabrikant, S. I., & Lacayo, M. (2010). Exploring the efficiency of users' visual analytics strategies based on sequence analysis of 
eye movement recordings. International Journal of Geographical Information Science, 24(10), 1559-1575. doi: doi: 
10.1080/13658816.2010.511718 

Coltekin, A., Heil, B., Garlandini, S., & Fabrikant, S. I. (2009). Evaluating the effectiveness of interactive map interface designs: a case study 
integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36( 1), 5-17. doi: 
doi: 10.1559/152304009787340197 

D'Zmura, M. (1991). Color in visual search. Vision research, 37(6), 951-966. doi: doi:10.1016/0042-6989(91)90203-H 

Dong, W., Liao, H., Roth, R. E., & Wang, S. (2014). Eye tracking to explore the potential of enhanced imagery basemaps in web mapping. The 
Cartographic Journal, 57(4), 313-329. 

Dong, W., Liao, H., Xu, F., Liu, Z., & Zhang, S. (2014). Using eye tracking to evaluate the usability of animated maps. Science China Earth 
Sciences, 57(3), 512-522. doi: doi: 10.1007/sl 1430-013-4685-3 

Ehinger, K. A., Hidalgo-Sotelo, B., Torralba, A., & Oliva, A. (2009). Modelling search for people in 900 scenes: A combined source model of 
eye guidance. Visual cognition, 17(6-1), 945-978. doi: doi:10. 1080/13506280902834720 

Gienko, G., & Levin, E. (2005, March 7-1 1). Eye-tracking in augmented photogrammetric technologies. Paper presented at the ASPRS 2005 
Annual Conference, Baltimore, Maryland. 

Gori, M., Giuliana, L., Sandini, G., & Burr, D. (2012). Visual size perception and haptic calibration during development. Developmental science. 
doi: doi: 10.1 1 1 1/j. 1467-7687.2012.01 183.x 

Granrud, C. E. (2004). Visual metacognition and the development of size constancy Thinking and seeing: Visual metacognition in adults and 
children (pp. 75-90). Cambridge, Massachusetts, London, England: The MIT Press. 

Granrud, C. E. (2012). Judging the size of a distant object: Strategy use by children and adults Visual experience: Sensation, cognition, and 
constancy (pp. 13-34). Oxford, United Kingdom: Oxford University Press. 

Grubert, A., & Eimer, M. (2013). Qualitative differences in the guidance of attention during single-color and multiple-color visual search: 

Behavioral and electrophysiological evidence. Journal of Experimental Psychology: Human Perception and Performance, 39(5), 
1433. doi: doi: 10.1037/a0031046 

Hatfield, G. (2014). Psychological Experiments and Phenomenal Experience in Size and Shape Constancy, doi: doi: 10.1086/677891 

Hayhoe, M., & Ballard, D. (2005). Eye movements in natural behavior. Trends in cognitive sciences, 9(4), 188-194. doi: 
doi: 10. 1016/j.tics.2005. 02.009 

Irina Fabrikant, S., Rebich-Hespanha, S., Andrienko, N., Andrienko, G., & Montello, D. R. (2008). Novel method to measure inference 

affordance in static small-multiple map displays representing dynamic processes. The Cartographic Journal, 45(3), 201-215. doi: 
doi: 10.11 79/000870408X3 11396 

Kenyon, R. V., Phenany, M., Sandin, D., & Defanti, T. (2008). Accommodation and size-constancy of virtual objects. Annals of biomedical 
engineering, 36(2), 342-348. doi: doi: 10.1007/sl0439-007-9414-7 

Kiefer, P., Giannopoulos, I., & Raubal, M. (2014). Where am I? Investigating map matching during self - localization with mobile eye tracking 
in an urban environment. Transactions in GIS, 18(5), 660-686. doi: doi: 10.1 1 1 1/tgis. 12067 

L.Chen. (1982). Topological structure in visual perception. Science, 218, 699-700. 

Ooms, K., De Maeyer, P., & Fack, V. (2010, Nov. 15-18, 2010). Analyzing eye movement patterns to improve map design. Paper presented at the 
18th International research symposium on Computer-based Cartography and GIScience (AutoCarto 2010): Geospatial data and 
geovisualization for the environments, security, and society, Orlando, FL, USA. 

Pizlo, Z. (2010). 3D shape: its unique place in visual perception'. Mit Press. 

Popelka, S., & Brychtova, A. (2013). Eye-tracking Study on Different Perception of 2D and 3D Terrain Visualisation. The Cartographic Journal, 
50(3), 240-246. doi: doi:10.1 179/1 74327741 3 Y.0000000058 

Putto, K., Kettunen, P., Tomiainen, J., Krause, C. M., & Tiina Sarjakoski, L. (2014). Effects of cartographic elevation visualizations and map- 
reading tasks on eye movements. The Cartographic Journal, doi: doi: 10.1 179/1743277414Y.0000000087 

Quinlan, P. T., & Humphreys, G. W. (1987). Visual search for targets defined by combinations of color, shape, and size: An examination of the 
task constraints on feature and conjunction searches. Perception & psychophysics, 47(5), 455-472. doi: doi: 10.3758/BF03203039 

Treisman, A., & Gormican, S. (1988). Feature analysis in early vision: evidence from search asymmetries. Psychological review, 95(1), 15. doi: 
10.1037/0033-295X.95.1.15 

Williams, L. (1966). The effect of target specification on objects fixated during visual search. Perception & psychophysics, 7(9), 315-318. doi: 
doi: 10.3758/BF032 15795 

Wolfe, J. M. (2012). The rules of guidance in visual search Perception and machine intelligence (pp. 1-10). Berlin: Springer. 



ICC 2017 : Proceedings of the 2017 International Cartographic Conference, Washington D.C. 


8 


Wolfe, J. M., & Horowitz, T. S. (2004). What attributes guide the deployment of visual attention and how do they do it? Nature Reviews 
Neuroscience, 5(6), 495-501. doi: doi:10.1038/nml41 1 



